Resolution Exchange Simulation 
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We extend replica exchange simulation in two ways, and apply our approaches to biomolecules. 
The first generalization permits exchange simulation between models of differing resolution — 
i.e., between detailed and coarse-grained models. Such "resolution exchange" can be applied to 
molecular systems or spin systems. The second extension is to "pseudo-exchange" simulations, 
which require little CPU usage for most levels of the exchange ladder and also substantially reduces 
the need for overlap between levels. Pseudo exchanges can be used in either replica or resolution 
exchange simulations. We perform efficient, converged simulations of a 50-atom peptide to illustrate 
the new approaches. 

Accepted for publication in physical review letters. 
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The simulation of biomolecules with 10 4 — 10 5 degrees 
of freedom has become routine, thanks to the accessi- 
bility of powerful computing resources, the development 
of reliable simulation software, and standardized empir- 
ical potential energy functions. For many biological ap- 
plications, such as binding free energy estimation, it is 
desirable to generate an equilibrated ensemble of con- 
formations. In principle, standard Monte Carlo (MC) 
and molecular dynamics (MD) algorithms are perfectly 
crgodic, and therefore will eventually generate such en- 
sembles. In practice, the \x sec — sec timescale, which de- 
scribes biologically relevant fluctuations, is not within 
reach of computation even for small proteins. 

Two broad strategies have been developed to address 
this problem. In one approach, dating to the earliest 
computational studies of proteinsQ, U coarse-grained 
protein representations are adopted. This strategy con- 
tinues to be popular 0,3- 

A second class of strategies attempts directly to 
enhance sampling of atomic-resolution models, in- 
cluding multiple time step methods^, |(|, replica 
exchange /parallel tempe ring 1st 1^, fl( | . and other gener- 
alized ensemble techniques [Tl|. Parallel tempering (PT), 
which employs a ladder of replicas simulated at increasing 
temperatures, is widely used for state-of-the-art molec- 
ular dynamics simulations, but presently is limited to 
small proteins[12|, as the resources required increase 
rapidly with the system size. 

This Letter presents two new tools for biomolecular 
simulation, by extending the PT approach and exploiting 
the speed of coarse-grained models. The first extension 
is a "resolution exchange" (res-ex) algorithm which — 
instead of using high-temperature simulation to increase 
sampling, as does PT — uses inexpensive coarse-grained 
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FIG. 1: Coarse-grained simulation accelerates transitions in 
high-resolution simulation with res-ex and ps-ex. (a) United 
atom trajectory for dileucine peptide, showing transitions be- 
tween a and /3 states, which is randomly re-ordered to create 
trajectory (b) with extremely rapid transitions. Performing 
pseudo-exchanges with the shuffled trajectory, the res-ex al- 
gorithm generates the all-atom trajectory in (c). The time 
axes in (c) and (d) differ by a factor of 20, underscoring the 
effectiveness of the ps-ex/res-ex protocol. 

models to cross barriers. Boltzmann-weighted ensembles 
are produced. The algorithm is implemented in close 
analogy to PT, and can also be applied to magnetic sys- 
tems (e.g., the Ising model). The res-ex approach is nat- 
ural for proteins, and indeed the kernel of the idea was 
suggested in the early days of protein simulation[| . More 
recently, the approach has been implemented in an ad hoc 
way, without proper statistical weighting 3] . A rigorous 
method to calculate free energy differences between all- 
atom and coarse-grained models was demonstrated by 
Warshel and coworkers fl3j. 

Our res-ex approach is conceptually related to work 
on Ising systems by Brandt and coworkers (e.g., [T3.[l5|). 
The res-ex approach is distinguished, however, by its sim- 
plicity, its ready applicability to biomolecules, and the 
ability to employ arbitrary coarse-grained Hamiltonians 
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- rather than truly renormalized Hamiltonians, as in 

MM 

We also introduce "pseudo-exchange" (ps-ex) processes 
which should significantly improve the efficiency of any 
type of exchange simulation, whether one swaps tempera- 
tures (as in PT), Hamiltonians ^(| or resolution (res-ex). 
Pseudo-exchanges are performed between a simulation in 
progress and one which has already been completed. The 
key advantage of ps-ex is that it permits uneven distri- 
bution of CPU time among levels of the exchange ladder. 
Because all exchange simulations are limited by the sam- 
pling obtained at the highest level — i.e., highest temper- 
ature (for PT) or lowest resolution (res-ex) — the bulk of 
CPU time should be devoted to this top level. Although 
an uneven distribution of CPU time among levels (repli- 
cas) would be awkward in a truly parallel implementa- 
tion, it is natural and highly efficient in a serial ps-ex 
simulation. Furthermore, there is essentially no disad- 
vantage to multiple independent runs, as compared to a 
single parallel simulation. 

Resolution Exchange Theory. The key idea behind 
res-ex is that, in addition to swapping temperature la- 
bels (PT) or parameters of the Hamiltonian one 
can also swap a subset of configurational coordinates. A 
well-chosen subset of coordinates of a detailed model can 
comprise the full set of coordinates for a coarse-grained 
model, as we demonstrate below. 

A general exchange process is constructed by con- 
sidering two independent simulations of a protein (or 
a spin system) carried out in parallel, each sampling 
its own distribution 7Ti or n-i. In common cases, 
the distributions will be given by 7Ti(<I>i, x^; k^; Ti) = 
exp (— C/($i,Xi; kJ/fc^Ti), where a configuration is com- 
posed of coordinates {$,x} which include an arbitrar- 
ily chosen "coarse" subset and where k denotes the 
parameters of the potential function U and fcgT is the 
product of Boltzmann's constant and the temperature. A 
general exchange process consists of a swap of a set of the 
arguments of the 7r functions: swapping T\ <-> T2 leads to 
PT, and swapping ki <-> k2 values leads to Hamiltonian 
exchange. To achieve resolution exchange, one can swap 
values of the set of coarse coordinates, $1 <-> $2, noting 
that the corresponding potential parameters k$ need not 
match in the two systems. It is indeed possible to swap 
an arbitrary combination of coordinates and parameters. 

Specializing, for clarity, to resolution exchange, we con- 
sider independent simulations governed by a "high resolu- 
tion" potential function Uh ({*&, x}) and a coarse-grained 
(low-resolution) potential Ul ({*&})■ Occasionally, we at- 
tempt an exchange move by swapping the {$} subset. 
The set {<i>, x} may be, for example, all the atomic coor- 
dinates of a protein, while the subset {<&} may be only 
the coordinates of the backbone. For a spin system, {$} 
may correspond to a block spin, and x to the orientations 
of the local spins relative to the block spin. 

To develop the exchange criterion, assume that at an 
exchange point the system is characterized by a high- 
resolution configuration {$ a ,x a } and a low-resolution 



configuration {$;,}. Attempting to exchange the {$} 
subset yields the trial conformations {$h,x a } and {& a }- 
Because the simulations are independent, the weight of 
the composite system is given by the simple product 
""tot = 7T17T2 = tthttl, and detailed balance will be sat- 
isfied if we accept such moves with a Metropolis rate 
min[l, R], where R is given by 

R _ 7Ti(new)7r 2 (new) _ n H ($ b ,Xg)n L ($ a ) 
7ri(old)7r 2 (old) ~~ 7r H ($ a ,a; Q )7r L ($ 6 )' 

The analogy to PT and Hamiltonian exchange is clear, 
but we have now extended the approach. 

Naturally, there are limitations on the types of models 
which can be successfully exchanged, much as PT tem- 
perature increments are limited. In the results presented 
below, we successfully performed exchanges between all- 
atom and united-atom models of a peptide. 

Pseudo-exchange simulation. The res-ex and PT al- 
gorithms are motivated by the likelihood that the "top 
level" simulation (i.e., lowest resolution or highest T) will 
more rapidly cross barriers and converge to an equilib- 
rium ensemble of conformations. While the associated 
convergence time is expected to be quite long, even for 
the top level, it is far from clear that the attainment of an 
equilibrium ensemble at a lower level requires the same 
length of simulation. Indeed, given that barriers should 
be crossed many times at the top level, signficantly less 
simulation time should be required at the lower levels of 
the exchange ladder. Our results show this to be true. 
Yet it would seem impossible to allot a priori appropri- 
ate CPU resources among the various ladder levels in a 
conventional parallel exchange simulation. 

A "pseudo exchange" process is the key to efficiently 
distributing computing time among ladder levels. The 
first step is to generate a well-sampled ensemble at the 
top level (highest temperature or lowest resolution) and 
randomly re-order this trajectory (FIG^i-IIJ)). While 
such shuffling preserves the distribution of states of the 
original trajectory, the shuffled trajectory exhibits a fea- 
ture key for exchange simulation: extremely rapid barrier 
hops, as in FIG^o. 

One now performs a ps-ex simulation with the shuf- 
fled trajectory. As with conventional exchange, one runs 
an independent lower level simulation (FIG^), but now 
exchanges are performed with the shuffled top-level tra- 
jectory. The identical Metropolis criterion is used — i.e., 
(JIJ or its PT analog. If the exchange attempt is success- 
ful, the new lower-level trajectory is continued from the 
accepted configuration, and the top-level trial configura- 
tion is simply discarded. The process is repeated as long 
as necessary. 

Pseudo-exchange processes are useful for several rea- 
sons: (i) ps-ex processes may be used with any exchange 
simulation; (ii) much lower acceptance ratios are still ef- 
ficient because frequent pseudo-exchange attempts are 
inexpensive in a serial scheme; and (iii) because of the 
weaker acceptance ratio requirements, larger gaps among 
ladder levels (e.g., T increments in PT) can be tolerated. 
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FIG. 2: The res-ex algorithm produces canonical sampling 
despite a poor coarse-grained potential, (a) Probability den- 
sities P(4>) for butane. Reference data obtained from stan- 
dard simulation are indicated by the solid line. The res-ex 
simulation with the asymmetric potential in (b) is plotted 
with triangles, and the res-ex simulation with the symmetric 
potential in (c) is plotted with circles. 

Simple res-ex demonstration: Butane. We present sim- 
ulation results for a single butane molecule, in order to 
show that the res-ex/ps-ex algorithm does indeed repro- 
duce the correct ensemble. For this purpose, butane is 
ideal, as it is small enough to permit generation of a 
converged ensemble by standard methods, which is then 
easily visualized by projecting onto a single reaction co- 
ordinate. 

Results are presented for two different low-resolution 
potentials, one of which intentionally breaks the sym- 
metry between the two gauche conformcrs. Comparison 
data were generated with the TINKER v. 4.2 simula- 
tion package , using the CHARMM-27 all-atom force 
field[l8|. The all-atom butane molecule was simulated in 
vacuum for 1 /isec, at a temperature of 298 K. Langevin 
dynamics were used, with a friction coefficient of 91 ps _1 . 
The same force field, dynamics, and simulation package 
were used for the high-resolution portions of the reso- 
lution exchange run, except that every 10 fsec a res-ex 
move was attempted. 10 5 resolution exchanges were at- 
tempted, for a total trajectory length of 1 nsec. 

FIG [5] compares the results of two different 1 nsec res- 
ex simulations to a 1 /isec reference trajectory. Plotted is 
the distribution of the C-C-C-C dihedral, <f>\, which mea- 
sures the populations of the three conformers. The res- 
ex simulations reproduce the equilibrium distribution, as 
measured in the comparison simulation, regardless of the 
potential used for the low-resolution simulation. The low- 
resolution model was a one-dimensional potential of the 
form Acos(30) + £?sin(0), where <j> is the C-C-C-C di- 
hedral. The asymmetric potential, shown in (b), has 
A = B = 1, while the symmetric potential in (c) has 
A = 1 and B = 0. 

Res- ex for a peptide: Dileucine peptide. We also tested 
the res-ex/ps-ex method on the dileucine peptide (ACE- 
(Leu) 2 -NME; "leucine dipeptide"). Though still a long 
way from a full size protein, 50 atom dileucine allows us 



to address a number of issues which need to be considered 
before tackling a full size protein. A united atom (UA) 
representation, which omits nonpolar hydrogens, is a nat- 
ural choice for the low-resolution model. For dileucine, 
this reduces the number of atoms from 50 in an all-atom 
(AA) representation to 24 in UA. 

The goal is to generate efficiently a converged ensem- 
ble of conformations for all-atom dileucine, using the ps- 
ex/res-ex protocol. We assess convergence by consider- 
ing the free energy difference between the two dominant 
conformations, distinguished by rotations about the ipi 
angle of leul and the 02 angle of leu2. Transitions be- 
tween these two basins are hampered by a significant 
barrier, and therefore occur rarely (approx. 1/3 nsec _ l 
at 300 K for AA). We define the "cv" conformations by 
-105 < -0i < and -145 < <fe < -25, and the con- 
formations by 30 < -01 < -155 and -160 < 2 < -40. 

The AA dileucine molecule was modelled with the 
OPLSaa force field [Tflj. For UA dileucine, we used a 
slightly modified version of the OPLSua force field [2fj| . 
altering a few of the bond length and bond angle pa- 
rameters to match those in the all-atom force field: these 
simple changes reduce the likelihood of exchange- induced 
steric clashes. Both simulations were carried out with the 
TINKER v. 4.2 simulation package[l7|, using Langevin 
dynamics with a 91 psec -1 friction coefficient, a 1 fsec 
integration timestep and GB/SA implicit solvation pi). 

Implementing the res-ex/ps-ex strategy, we first car- 
ried out a simulation of united-atom dileucine (FIG^a)). 
We then randomly reshuffled this trajectory (FIG^b)) 
in order to generate a pseudo-trajectory with much more 
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FIG. 3: Res-ex simulation accelerates equilibration among 
dileucine peptide substates. Dashed lines show running esti- 
mates of the inter-substate AG a /3 as a function of time for 
8 independent, 40 nsec trajectories, and the solid line shows 
the estimate of AG a /3 from 600 nsec of standard simulation. 
Each symbol with error bars gives the average and range of 
8 independent resex simulations, displaced from the origin 
to reflect total CPU time (measured in all-atom timesteps), 
including investment in the united atom simulation. The ef- 
ficiency gain can be estimated by the relative ranges of the 
AG a( 3 estimates. 
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frequent a f3 transitions than are observed in the orig- 
inal trajectory. This randomized trajectory (still Boltz- 
mann distributed) is then used to generate the all-atom 
trajectory (FIG^c)) via the res-ex protocol. Notice that 
a <-> (3 transitions are observed far more frequently in the 
all-atom trajectory with exchange (about 30/nsec) than 
without (about 1/3 nsec, FIGHfd)). 

Assessing convergence and efficiency of a protein simu- 
lation are generally difficult tasks. Fortunately, the situ- 
ation here is relatively simple, as we can consider the free 
energy difference between the a and (3 substates (AG a p). 
In FIG |3 8 res-ex simulations are compared to 8 stan- 
dard stochastic dynamics simulations. Each res-ex data 
point represents the average and range of 8 independent 
res-ex trajectories, with res-ex moves attempted every 10 
fsec. The res-ex estimates are displaced from the origin 
to reflect the time invested in the united atom model. We 
allotted AA simulation time based upon matching preci- 
sion among levels — i.e., generating the same number of 
inter-basin hops as in the UA simulation. Convergence is 
assessed by considering the spread among the indepen- 
dent simulations. 

It is clear that the res-ex simulations reproduce the 
AG a {3 estimated from the standard simulations. This 
is accomplished despite the failure of the united atom 
model to reflect correctly the populations of the a and 
(3 states: AG Q/ 3 (united atom) = O.Q90ksT, with the 
wrong sign. This is an important point, as it is known 
that united atom models do not reproduce all atom 
behavior |22|. More important for res-ex simulation is 
that the coarse-grained model explores conformational 
space more rapidly, as well as being "exchangeable" with 
the more detailed model. 

It is further clear that the res-ex results are generated 
with significantly higher efficiency. For a given amount of 
CPU time (nsec in FIGdJ), the res-ex estimates exhibit 
high accuracy with a greatly reduced uncertainty. For 
example, 5 nsec of resolution exchange simulation gen- 
erated an estimate for AG a p = —1.25 ± 0.40fcsT, while 
75 nsec of standard simulation are required to reach a 
comprable level of accuracy and precision, indicating a 
15-fold savings in CPU time. We emphasize that our 
analysis gives a true efficiency estimate, since it includes 
the total CPU time, rather than the cost for one of many 
parallel simulations. 

The acceptance ratio of attempted pseudo exchange 
moves need not be 20%, as conventional wisdom 
dictates[23|. Indeed, even a very small fraction of ac- 
cepted exchanges can greatly enhance efficiency, provided 
those exchanges generate novel conformations. The goal 
is to optimize diffusion in conformation space, not ac- 
ceptance ratio. In res-ex trajectories presented here the 
average acceptance ratio was only 0.156%. Nonetheless, 
high efficiency is obtained because successful exchanges 
with a shuffled top-level trajectory are very likely to gen- 



erate novel conformations, at a fraction of the cost of 
standard simulation. 

Discussion. We have introduced two extensions of 
parallel-tempering/replica-exchange which show promise 
for improved efficiency of biomolccular simulations. 
"Resolution exchange" enhances sampling of an expen- 
sive, high-resolution model using a cheaper, coarse- 
grained model with the resolution exchange protocol. 
Generalization to a ladder of models is formally triv- 
ial. The sampling in the high-resolution model satis- 
fies detailed balance, and therefore generates an equilib- 
rium ensemble. The further introduction of the "pseudo- 
exchange" process permits the bulk of computer re- 
sources to be invested in sampling and crossing barriers 
at the top level of the exchange ladder (highest temper- 
ature or lowest resolution), and only incremental addi- 
tional simulation is required at lower levels. 

The treatment of even larger, more complex molecules 
will be the subject of future research. We emphasize that 
our efficiency gains were obtained using only a two-level 
ladder, implying that much greater efficiency is possible 
with additional levels — which can be added at small 
cost via pseudo-exchange. A long-term goal is to develop 
a full ladder of reduced, exchangeable models, extending 
up to the "united residue" level, because even UA compu- 
tations require long simulation times. For temperature- 
based exchange, a PT implementation of the pseudo- 
exchange approach can be applied to explicitly solvated 
proteins with only a minimum of modification to common 
software packages. Our own preliminary PT/ps-ex sim- 
ulations indicate, interestingly, that successful dileucine 
exchanges can easily be implemented with temperature 
gaps of 200 K or more. Ultimately, resolution and tem- 
perature exchange might be combined for high-efficiency 
simulations of biomolecules. 

Two limitations should be mentioned. First, we do not 
expect the present algorithm to enable exchange between 
continuum and explicit solvent representations. How- 
ever, the present degree of undersampling of proteins, 
when using continuum solvent representations, warrants 
pursuit of this problem in its own right. A second lim- 
itation is that, to be exchangeable, two models must be 
sufficiently "similiar" : there should be overlap between 
low-energy coarse variable conformations. Yet, a process 
of incremental coarsening — changing part of a molecule 
at a time, and which we have already implemented for 
dileucine (data not shown) — will minimize this difficulty 
for larger systems. 
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